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(57) A format converter which performs frame rate previous frame from a frame to be interpolated; setting 
conversion and de-interlacing using a bidirectional mo- the motion vector of a neighboring block that has the 
tion vector and a method thereof are provided. The minimum error distortion, among motions vectors esti- 
method includes the steps of (a) estimating a bidirec- mated in the step (a), as the motion vector of the current 
tional motion vector between the current frame and the block; and (c) forming a frame to be interpolated with 

the motion vector set in the step (b). 
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Description 

BACKGROUND OF THE INVENTION 

5 1 . Field of the Invention 

[0001] The present invention relates to an image signal format converter and a method thereof, and more particularly, 
to a format converter which performs frame rate conversion and de-interlacing using a bidirectional motion vector, and 
a method thereof. 

w 

2. Description of the Related Art 

[0002] Generally, in a PC or a high definition TV (HDTV), conversion of a format such as a frame rate and de- 
interlacing is needed to exchange programs having various signal standards. 
15 [0003] FIG. 1 is a block diagram of a conventional frame rate conversion apparatus. 

[0004] Referring to FIG. 1 , an image dividing unit 110 divides an image into a changed region and an unchanged 
region for efficient motion estimation as shown in FIG. 2. The unchanged region is divided again into a covered region, 
an uncovered region, a background, and an object. 

[0005] A motion estimating unit 120 generates the motion vector of a block using a block matching algorithm which 
20 is generally used in video coding. In a representative existing block matching algorithm, a motion vector is found out 
for each block on the assumption that pixels in a predetermined-size block, as shown in FIG. 3, only moved without 
rotation, magnification, or reduction. In FIG. 3, it is assumed that the motion vector of an N x N size base block located 
on an arbitrary coordinates (x c , y c ) in the current frame (f c ) is estimated in a range of + P pixels from the previous frame 
(f p ). Then, the search range in the previous frame is (N+2P) x (N+2P). Therefore, the motion vector is determined as 
25 a location which has the maximum correlation among total (2P+1) 2 candidate locations. At this time, the difference 
between the base block in the current frame and the candidate block in the previous frame is calculated as a mean 
absolute difference (MAD) as the following equation 1: 



so | N N 

MAD = -2-£ X \f c (x c + i,y c + j)-f p (x c + /+ m,y c + /+ n)\ (1) 

/v 1=1 y-i 

35 [0006] Here, the motion vector of the final block is determined as a location (m, n) of a search range of which the 
mean absolute difference between the current block and the candidate block is the minimum. 
[0007] A spatiotemporal smoothing unit 1 30 refines an inappropriate motion vector obtained in the motion estimating 
unit 1 20, and refines the smoothness of a motion vector as shown in FIG. 4. 

[0008] A motion-compensated interpolation unit 140 finds a forward motion vector for the previous frame and the 
40 next frame of an image to be interpolated, and using the obtained motion vector, performs bidirectional interpolation 
according to region classification information generated in the image dividing unit 110. At this time, as shown in FIG. 
5, the motion-compensated interpolation using a forward motion vector generates overlaps, where blocks are over- 
lapped because two or more motion vectors are assigned in a frame to be interpolated, and holes where motion vector 
is not assigned,. These overlaps and holes directly affect the picture quality of an image and degrade the picture quality. 
45 Also, since these overlaps and holes have irregular shapes, they should be handled on a pixel-by-pixel basis. Therefore, 
for the conventional apparatus, complicated signal processing processes and complicated hardware therefor should 
be implemented to remove the overlaps and holes. 

[0009] Also, for an ordinary television video signal, a frequency band is compressed using an interlacing method in 
which two fields forms a frame. Recently, in a PC or an HDTV which displays generally using a progressive scanning, 
so to display an interlaced image, image lines, which are empty by de-interlacing, are generated by an arbitrary method 
for progressive scanning. 

[0010] FIG. 6 is a conceptual basic diagram of ordinary de-interlacing. 

[0011] Referring to FIG. 6, de-interlacing changes afield containing only an odd-numbered pixel, or only an even- 
numbered pixel, into a frame. At this time, an output frame F 0 (x , n) is defined as the following equation 2: 

55 
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F 0 (x,n) = 



F(x, n), {y mod 2 = n mod 2), 
F t (x,n), otherwise 



••(2) 



[0012] Here, x means a spatial location, and n is a field number. F(x , n) is an input field, and F|(x , n) is a pixel to 
be interpolated. 

[0013] FIG. 7 is a 3 x 3 window for applying edge-based line averaging (ELA) de-interlacing algorithm which does 
not use motion compensation. 

[0014] Referring to FIG. 7, ELA de-interlacing uses correlation between pixels considering direction (x, y) from the 
location of a pixel to be interpolated as the following equation 3. That is, the mean value of pixels neighboring a pixel 
to be interpolated and pixels to be interpolated in the previous field and the next field of the field to be interpolated is 
output: 



F{x-u x F(x+u x +u y ,n)/2, if min(a,b,c)=a, 

F(x-u +u ri)+ F(x+u - u w)/2, // m'm(a,b,c)=b, 
xy x y 



F(x-u y ,n)+ F(x+u y ,n)/2, 



otherwise 



here, a=\F(x- $ x - u y ,n)- F(x+ u x + u y ,n)\ 
b = |f(x - u x + u y ,n) - F(x + $ x - u y ,n)| 
c=\F(x-u y ,n)-F(x+u y Si)\ 



•(3) 



[0015] FIG. 8 is a conceptual diagram for explaining an ordinary time-recursive (TR) de-interlacing method. 
[0016] Referring to FIG. 8, TR de-interlacing using a motion vector assumes that the previous field (n-1) is perfectly 
35 de-interlaced, and the missing data of the current field (n) is compensated with a motion vector. A pixel to be interpolated 
can be the original pixel of the previous field, or a previously interpolated pixel. Therefore, a pixel to be interpolated 
can be expressed as the following equation 4: 



F 0 (x,n) - 



F(x,n), (^mod2 = nmod2), 

F{x - d{x,n),n- 1), otherwise (4) 



[0017] However, since ELA de-interlacing method does not use motion compensation, flickering occurs in a region 
where motions exist, and since TR de-interlacing method is continuously de-interlaced, an error occurred in an arbitrary 
field can be propagated to other fields. 



50 SUMMARY OF THE INVENTION 



[0018] To solve the above problems, it is an object of the present invention to provide a frame rate converting method 
which refines a picture quality by directly obtaining a bidirectional motion vector of two continuous frames for a pixel 
to be interpolated. 

55 [0019] It is another object to provide a frame rate converter using the frame rate converting method. 

[0020] It is another object to provide a de-interlacing method which by estimating a bidirectional motion vector be- 
tween two continuous fields for a pixel to be interpolated, is easy to perform and has an excellent outline-keeping ability. 
[0021] It is another object to provide a de-interlacing apparatus using the de-interlacing method. 
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[0022] It is another object to provide a de-interlacing apparatus which can enhance reliability of motion information 
and reduce errors in a pixel to be interpolated by adaptively selecting between motion-compensated interpolation value 
and spatiotemporal interpolation value according to the degree of motion of an input image. 
[0023] To accomplish the above object of the present invention, there is provided a frame rate converting method 

5 having the steps of (a) estimating a bidirectional motion vector for a frame to be interpolated using motion vectors 
between the current frame and the previous frame; (b) setting the motion vector of a neighboring block that has the 
minimum error distortion, among motions vectors estimated in the step (a) in a frame to be interpolated, as the motion 
vector of the current block; and (c) forming a frame to be interpolated with the motion vector set in the step (b). 
[0024] To accomplish another object of the present invention, there is also provided a frame rate converter having 

10 a bidirectional motion estimating means for obtaining the motion vector between the current frame and the previous 
frame, assigning the motion vector to a frame to be interpolated, and estimating the assigned motion vector for a frame 
to be interpolated; a spatiotemporal smoothing unit for evaluating the accuracy of the motion vector of the current block 
in the frame to be interpolated in the bidirectional motion estimating means, and then setting the motion vector of a 
neighboring block, which has the minimum error distortion, as the motion vector of the current block; and an interpolation 

15 unit for extending the block to be interpolated, and interpolating with the motion vector obtained in the spatiotemporal 
smoothing unit in an overlapped region with different weights. 

[0025] To accomplish another object of the present invention, there is also provided a de-interlacing method having 
(a) estimating a bidirectional motion vector for a pixel to be interpolated using motion vectors between the previous 
field and the next field; (b) setting the motion vector of which neighboring error distortion is the minimum in the step 
20 (a) as the motion vector of a pixel to be interpolated; and (c) forming the pixel to be interpolated with the motion vector 
set in the step (b). 

[0026] To accomplish another object of the present invention, there is also provided a de-interlacing apparatus having 
a bidirectional motion estimating means for obtaining the motion vector between the current field and the previous 
field, assigning the motion vector to a field to be interpolated, and estimating the assigned motion vector for a field to 

25 be interpolated; a spatiotemporal smoothing unit for evaluating the accuracy of the motion vector of the current block 
in the field to be interpolated in the bidirectional motion estimating means, and then setting the motion vector of a 
neighboring block, which has the minimum error distortion, as the motion vector of the current block; and a signal 
converting unit for forming a pixel of a line having no data, with the median value of pixel values obtained by applying 
the motion vector set in the spatiotemporal smoothing unit, the mean value of the pixel values, and the values of pixels 

30 vertically neighboring the pixel to be interpolated. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0027] The above objects and advantages of the present invention will become more apparent by describing in detail 
35 a preferred embodiment thereof with reference to the attached drawings in which: 

FIG. 1 is a block diagram of a conventional frame rate conversion apparatus; 
FIG. 2 is a diagram for explaining an image dividing method in the image dividing unit of FIG. 1 ; 
FIG. 3 is a diagram for explaining a motion estimating method in the motion estimating unit of FIG. 1 ; 
40 FIG. 4 illustrates a screen before refinement and a screen after refinement in the spatiotemporal smoothing unit 

of FIG. 1; 

FIG. 5 is an example of the structure of an image interpolated by motion compensation in the motion-compensated 
interpolation unit of FIG. 1; 

FIG. 6 is a conceptual basic diagram of ordinary de-interlacing; 
45 FIG. 7 is a 3x3 window for applying edge-based line averaging (ELA) de-interlacing algorithm which does not use 

motion compensation; 

FIG. 8 is a diagram for explaining motion vector estimation for each block in the spatiotemporal smoothing unit of 
FIG. 6; 

FIG. 9 is a block diagram of a frame rate conversion apparatus according to the present invention; 
50 FIGS. 1 0A through 1 0C are conceptual diagrams for obtaining a bidirectional motion vector; 

FIG. 11 is a conceptual diagram for refining a motion vector of the spatiotemporal smoothing unit of FIG. 9; 
FIG. 1 2 is a conceptual diagram for explaining a motion-compensated interpolation method of the refined motion- 
compensated interpolation unit of FIG. 9; 

FIG. 13 is a block diagram of a de-interlacing apparatus according to the present invention; 
55 FIG. 14 is a conceptual diagram for showing decimation conversion of the motion estimating unit of FIG. 13; 

FIG. 15 is a conceptual diagram for showing motion-compensated de-interlacing in the signal conversion unit of 
FIG. 13; 

FIG. 16 is a conceptual diagram for showing spatiotemporal interpolation using a median filter in the signal con- 
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version unit of FIG. 13; and 

FIG. 17 is another embodiment of a de-interlacing apparatus according to the present invention. 
DETAILED DESCRIPTION OF THE INVENTION 

5 

[0028] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached 
drawings. The present invention is not restricted to the following embodiments, and many variations are possible within 
the spirit and scope of the present invention. The embodiments of the present invention are provided in order to more 
completely explain the present invention to anyone skilled in the art. 
w [0029] FIG. 9 is a block diagram of a frame rate conversion apparatus according to the present invention 

[0030] The apparatus of FIG. 9 includes a motion estimating unit 210, a spatiotemporal smoothing unit 220, and a 
refined motion-compensated interpolation unit 230. 

[0031] Referring to FIG. 9, the motion estimating unit 210 obtains a motion vector between the current frame and 
the previous frame, and assigns the motion vector to a frame to be interpolated, and estimates a bidirectional motion 
15 vector for the frame to be interpolated. 

[0032] The spatiotemporal smoothing unit 220 evaluates the accuracy of the motion vector of the current block es- 
timated in frame to be interpolated, and then sets a motion vector of neighboring blocks, of which error distortion is the 
minimum, to the motion vector of the current block. 

[0033] The refined motion-compensated interpolation unit 230 forms a block to be interpolated with the mean of 
20 blocks in the previous frame and the next frame of the frame to be interpolated, using the motion vector obtained in 

the spatiotemporal smoothing unit 220. At this time, the refined motion-compensation interpolation unit 230 extends 

the block to be interpolated and interpolates with different weights in an overlap region. 

[0034] FIGS. 1 0A through 1 0C are conceptual diagrams for obtaining a bidirectional motion vector. 

[0035] First, in two neighboring frames, F n .., is (n-1)-th frame, F n+1 is (n+1)-th frame, and F n is n-th frame. In the n- 
25 th frame ( F n ), as shown in FIGS. 1 0A through 1 0C, a bidirectional motion vector is obtained through a motion vector 

initialization state (FIGS. 10A and 10B) and a motion vector adjusting stage (FIG. 10C). 

[0036] Referring to FIG. 10A, the motion vector initialization stage will now be explained. 

[0037] First, (n-1)-th f/ame/field ( F n .-,) and (n+1 )-thXrame/field (F n+1 ) are decimated in 2:1 ratio, and reconstructed 
to (n-1)-th frame/field (F^) and (n+1)-th frame/field (F^). 

30 [0038] Then, as shown in FIG. 1 0A, the (n+1 )-th frame/field (^F^) is divided into a plurality of blocks, and a search 
range for each block is determined. Then, in the search range, by applying a block matching algorithm (BMA), a forward 
motion vector (MV) is estimated. Then, as shown in FIG. 10B, the n-th frame/field (FJ to be interpolated is divided by 
block, and the estimated forward MV is set as an initial MV of the n-th frame/field (F n ) to be interpolated. Therefore, 
by compensating a motion according to the block grid of each block using a bidirectional motion vector as shown in 

35 FIG. 1 0B, overlaps and holes do not occur in the existing video signal. 

[0039] Next, referring to FIG. 10C, the motion vector adjusting stage will now be explained. First, since the forward 
MV is used in the initialization stage, the initial MV obtained in the motion vector initialization stage changes a little. To 
correct this, taking the forward MV obtained in the motion vector initialization stage as an initial value, a small search 
range (± d) is newly set. Then, using BMA again in the small search range (+ d), the motion vector set in the initial 

40 stage is corrected, and then a bidirectional motion vector is generated. To explain the adjusting stage for the initial MV 
shown in FIG. 10C, an arbitrary block (B ti ) in the n-th frame/field (F„) to be interpolated is considered. The center of 
the block (B ti ) is (x,y), and corresponds to the initial MV (0) = (h, v)) . At this time, the initial MV 0) simultaneously 
shows^the motion between the n-th frame/field (F„) to be, interpolated for the arbitrary block (B ti ) and (n+1)-th frame/ 
field (F n+1 ) and the motion from the (n-1)-th frame/field (F^) to the n-th frame/field (F n ) to be interpolated. Then, if the 

45 arbitrary block (B ti ) on the n-th frame/field (F„) to be interpolated moves by the initial MV 0), the arbitrary block, (B ti ) 
is generated by the block (B t1 ) of the (n-1)-th frame/field (F ;>1 ) and the block (B t2 ) of the (n+1 )-th frame/field (F n+1 ). 
That is, the centers of the initial block (B t1 )and block (B t2 ) can be expressed as the following equation 5: 

50 B t1 (x t1 ,y t1 ) = (x, y)-(h, v) = (x-h, y+v) 

B t2 ( x t2'Yt2)= y)+( h ' v ) = ( x+h > y +v ) ( 5 ) 

[0040] Here, the arbitrary block (B ti ) is located on a fixed location, and each of bloc|< (B t1 ) and block (B t2 ) moves from 
55 the initial location within the search range (+ d). At this time, if the n-th frame/field (F„) should be located in the center 
between the (n-1)-th frame/field (F„_ ? ) and the (n+1)-th frame/field (F^), the motion between the block (B t1 ) and the 
arbitrary block (B ti ) should be the same as the motion between the arbitrary block (B ti ) and the block (B t2 ). For this, on 
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the motion trajectory of the initial MV, the block (B t1 ) and the block (B t2 ) should move symmetrically from the center of 
the block (B ti ) to be interpolated. 

[0041] Therefore, the number of possible combinations in case «f having search range (+ d) is (2oX+ 1) 2 . After this 
process, the^idirectional vector between the (n-1)-th frame/fiejd (F^) and the (n+1)-th frame/field (F n+1 ) for the n-th 

5 frame^ield (F„) is obtained. At this time, j| the n-th frame/field (F„) should be at the center between the (n-1)-th frame/ 
field (F^) and the (n+1)-th frame/field (F n+1 ), the motion vector to each direction has the same value. 
[0042] FIG. 11 is a conceptual diagram for refining amotion vector of the spatiotemporal smoothing unit 220 of FIG. 9. 
[0043] Referring to FIG. 11, first, in the frame/field to be interpolated, the current block is set as MV 0 , candidate MV 
blocks surrounding the current block are set as MV, (i=1 ,..,8), and the motion vector of the block is set as D(- ). Then, 

10 the motion vector of a block having the minimum MAD among the motion vectors of the candidate blocks is set as the 
motion vector of the current block. That is, as the following equation 6, using the bidirectional motion vector between 
two neighboring frame/fields, the displaced frame difference (DFD) of the current block is obtained and then the motion 
vector of the candidate block having the minimum DFD is set as the motion vector of the current block. In conclusion, 
the spatiotemporal smoothing refines picture quality by removing inappropriate motion vector detected in the motion 

15 estimation. 



DFD(D) = Y\fn(P-D)-f t2 (p+D)\ (6) 



[0044] FIG. 12 is a conceptual diagram for explaining a motion-compensated interpolation method of the refined 
motion-compensated interpolation unit 230 of FIG. 9 

[0045] Referring to FIG. 12, the refined motion-compensated interpolation unit 230 forms a frame to be interpolated 
25 after taking the block mean of the two neighboring frames as the following equation 7 using the motion vector obtained 
bidirectionally. At this time, the frame to be interpolated extends the original block size horizontally and vertically, and 
is interpolated in the overlapped region with different weights. 

30 MP) = \[ft,(P - D(B(p)))-f t2 (p- D(B(p)))] (7) 

[0046] FIG. 1 3 is a block diagram of a de-interlacing apparatus according to the present invention. 

[0047] Referring to FIG. 13, F n _i, which is input first, is (n-1)-th field, F n is n-th field, and F n+1 is (n+1)-th field. P n is 

a video signal which is converted from the n-th field (F n ) for progressive scanning. 

35 [0048] A motion estimating unit 41 0 obtains the motion vector of the n-th field (F n ), which corresponds to the location 
of the field to be interpolated, after obtaining the bidirectional motion vector, from the (n-1)-th field (F n ..,) and the (n+1)- 
th field (F n+1 ). The bidirectional motion vector to be obtained in the n-th field (F n ) is obtained by calculating the fields, 
for which decimation conversion have been performed, through the motion vector initialization stage (FIGS. 10A and 
10B) and the motion vector adjusting stage (FIG. 10C). As a result, for the field to be interpolated, the bidirectional 

40 motion vector between the previous field and the next field is calculated. 

[0049] A spatiotemporal smoothing unit 420, as described in FIG. 11, obtains a bidirectional motion vector, which is 
smoothed through spatiotemporal smoothing, because bidirectional motion vectors obtained in the motion estimating 
unit 41 0 have some discontinuity. 

[0050] A signal converting unit 430 is an interlaced-to-progressive conversion block, restores no-data lines of n-th 
45 field (F n ) with the mean of pixels to which bidirectional motion vectors generated in the spatiotemporal smoothing unit 
420 are applied, and outputs the final frame ( P n ). 

[0051] FIG. 14 is a conceptual diagram for showing decimation conversion of the motion estimating unit 410 of FIG. 
13. 

[0052] RefeRring to FIG. 14, the (n-1 )-trxf iefd (F n .-,) and the (n+1)-th field (F n+1 ) are input and reconstructed to the 
50 (rx-1 )-th field (F^) and th,e (n+1 )-th field (F n+1 ), only with the lines having data. That is, the reconstructed (n-1 )-th field 
(F n _i) and (n+1)-th field (F n+1 ) are reduced frpm the input (n-1)-th fielqUF^) and (n+1)-th field (F n+1 ) by half vertically. 
Therefore, the reconstructed (n-1 )-th field (F^) and (n+1)-th field (F n+1 ) are decimated in a 2:1 ratio vertically and 
horizontally. 

[0053] FIG. 15 is a conceptual diagram for showing motion-compensated de-interlacing in the signal conversion unit 
55 430 of FIG. 13. 

[0054] Referring to FIG. 15, no-data lines of the n-th field (F n ) is restored, using the bidirectional motion vector of 
the field (F„) to be interpolated. The restoration process can be expressed as the following equation 8: 



EP1 164 792 A2 



F " = 2 (8) 

[0055] Here, x and y are the abscissa value and the ordinate value respectively in each field, and h and v are the 
horizontal component and the vertical component, respectively, of the bidirectional motion vector. 
[0056] FIG. 16 is a conceptual diagram for showing spatiotemporal interpolation using a median filter in the signal 
conversion unit of FIG. 13. 

[0057] The performance of a de-interlacing method is affected greatly by the result of motion estimation. Therefore, 
to reduce an error in motion estimation, no data lines in the field (F„) to be interpolated are interpolated using a median 
filter as shown in FIG. 16, and it can be expressed as the following equation 9: 

if p is in the existing line, 

(C+D) 

Median(A,B,C,D, otherwise, (9) 

[0058] Here, pixels A, B, C, and D are defined as follows: 




A= F n (p -U y ),B= F n (p + u y ),C= F, M (p -75), D = F„ +1 (p + ft) 

25 

[0059] Here, 5 is a bidirectional motion vector, u y is (0, 1) T , and (C+D)/2 is the resulting value of the motion-com- 
pensated de-interlacing as the equation 9. A 

[0060] As this, if the median filter is used, the frame (F n ) to be finally output takes the original pixel if the line has 
data, and otherwise is interpolated with the median value of the pixel (C) of the (n-1 )-th field, the pixel (D) of the (n+1 )- 
30 th field, pixels (A, B) which are vertically neighboring the pixel (Z) to be interpolated in the n-th field, and de-interlaced 
pixel ((C+D)/2), as the pixel (Z) of the n-th field. 

[0061] FIG. 17 is another embodiment of a de-interlacing apparatus according to the present invention. 
[0062] Referring to FIG. 17, a motion-compensated interpolation unit 172 interpolates with the mean of pixels using 
the interpolation value of a frame, that is a motion vector, as shown in FIG. 13 according to the present invention, or 
35 outputs the median value of pixel values, to which a motion vector is applied, the mean value of the pixels, and 
the value between two pixels which are vertically neighboring a pixel to be interpolated. 

[0063] A spatiotemporal interpolation unit 1 76 outputs the mean value of pixels neighboring a pixel to be interpolated 
and pixels on the locations to be interpolated in the previous field and the next field of the field to be interpolated, as 
the interpolation value of a frame. 
40 [0064] A motion evaluation unit 1 74 evaluates the degree of motion using the MAD value of the current block calcu- 
lated in the motion estimating unit 410 of FIG. 13. 

[0065] A motion adaptation unit 178 sets the value of a pixel to be finally interpolated by adaptively calculating the 
output value of the motion-compensated interpolation unit 172 and the output value of the spatiotemporal interpolation 
unit 176 according to the degree of motion evaluated in the motion evaluation unit 174. 
45 [0066] Therefore, the de-interlacing apparatus of FIG. 17 prevents the error which occurs when an inaccurate motion 
vector is used in the process for determining the presence of a motion. 

[0067] As described above, according to the present invention, by obtaining the bidirectional motion vector between 
two frames for a frame to be interpolated, overlaps and holes do not occur. Therefore, picture quality can be improved 
and particularly, panning or zooming image having a camera motion can be efficiently processed. Also, noise on a time 
so axis between fields and flickers between lines, which occur in the existing method, can be reduced, and the ability to 
keep outlines is better than the existing de-interlacing methods. Also, by adaptively selecting between a motion-com- 
pensated interpolation value and a spatiotemporal interpolation value according to the degree of the motion of an input 
image, reliability of information on a motion is enhanced compared to the method simply using a motion-compensated 
interpolation value, and artifact can be efficiently reduced. 

55 
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Claims 

1 . A frame rate converting method comprising the steps of: 

5 (a) estimating a bidirectional motion vector for a frame to be interpolated using motion vectors between the 

current frame and the previous frame; 

(b) setting the motion vector of a neighboring block that has the minimum error distortion, among motions 
vectors estimated in the step (a) in a frame to be interpolated, as the motion vector of the current block; and 

(c) forming a frame to be interpolated with the motion vector set in the step (b). 

w 

2. The method of claim 1 , wherein the step (a) further comprises the sub-steps of: 

(a-1) detecting a motion vector between the current frame and the previous frame, and assigning the motion 
vector to a frame to be interpolated; and 
15 (a-2) adjusting the motion vector assigned in the step (a-1 ) in the frame to be interpolated according to a block 

grid. 

3. The method of claim 2, wherein the detecting in the step (a-1) further comprises the steps of: 

20 decimating an image; and 

estimating a motion vector from the decimated image. 

4. The method of claim 2, wherein the step (a-2) is the step for estimating a value, which has the minimum error 
among blocks of the previous frame and the current frame which linearly pass through the center of a block formed 

25 according to the block grid, as the bidirectional motion vector of the frame block to be interpolated in the frame to 

be interpolated. 

5. The method of claim 1 , wherein the step (b) includes the step for evaluating the accuracy of the motion vector of 
the current block in the frame to be interpolated and setting the motion vector of neighboring block which has the 

30 minimum error distortion, as the motion vector of the current block. 

6. The method of claim 1 , wherein the step (b) includes the steps of: 

assigning a motion vector for the frame to be interpolated; 
35 evaluating the accuracy of the motion vector of the current block; and 

setting the motion vector of a neighboring block which has the minimum error distortion, as the motion vector 
of the current block. 

7. The method of claim 1 , wherein in the step (c) a block to be interpolated is formed with the mean of blocks, using 
40 the estimated motion vector in a frame to be interpolated. 

8. The method of claim 1, wherein in the step (c) the block to be interpolated is extended and interpolated in an 
overlapped region with different weights. 

45 9. A frame rate converter comprising: 

a bidirectional motion estimating means for obtaining the motion vector between the current frame and the 
previous frame, assigning the motion vector to a frame to be interpolated, and estimating the assigned motion 
vector for a frame to be interpolated; 
so a spatiotemporal smoothing unit for evaluating the accuracy of the motion vector of the current block in the 

frame to be interpolated in the bidirectional motion estimating means, and then setting the motion vector of a 
neighboring block, which has the minimum error distortion, as the motion vector of the current block; and 
an interpolation unit for extending the block to be interpolated, and interpolating with the motion vector obtained 
in the spatiotemporal smoothing unit in an overlapped region with different weights. 
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10. A de-interlacing method comprising: 



(a) estimating a bidirectional motion vector for a pixel to be interpolated using motion vectors between the 
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previous field and the next field; 

(b) setting the motion vector of which neighboring error distortion is the minimum in the step (a) as the motion 
vector of a pixel to be interpolated; and 

(c) forming the pixel to be interpolated with the motion vector set in the step (b). 

5 

11. The de-interlacing method of claim 1 0, wherein the step (a) further comprises the sub-steps of: 

(a-1) detecting the motion vector between the current field and the previous field, and assigning the motion 
vector to a field to be interpolated; and 
10 (a-2) adjusting the motion vector assigned in the step (a-1) according to a block grid in a frame to be interpo- 

lated. 

12. The de-interlacing method of claim 1 0, wherein the step (a-2) is the step for estimating a location value, which has 
the minimum error among blocks of the previous field and the current field which linearly pass through the center 

15 of block formed according to the block grid in the field to be interpolated, as the bidirectional motion vector of the 

block of the field to be interpolated. 

13. The de-interlacing method of claim 10, wherein the step (b) includes the step for evaluating the accuracy of the 
motion vector of the current block in the field to be interpolated and setting the motion vector of neighboring block 

20 which has the minimum error distortion, as the motion vector of the current block. 

14. The de-interlacing method of claim 1 0, wherein the step (b) includes the steps of: 

adjusting a motion vector for the field to be interpolated; 
25 evaluating the accuracy of the motion vector of the current block; and 

setting the motion vector of a neighboring block which has the minimum error distortion, as the motion vector 
of the current block. 

15. The de-interlacing method of claim 10, wherein in the step (c) a pixel to be interpolated is formed with the mean 
30 of pixels, using the estimated motion vector in a field to be interpolated. 

16. The de-interlacing method of claim 10, wherein in the step (c) the median value of pixel values, to which the 
estimated motion vector is applied, of the previous field and the next field of the field to be interpolated, the mean 
value of the pixels, and the values of two pixels vertically neighboring a pixel to be interpolated, is set to a pixel to 

35 be interpolated. 

17. The de-interlacing method of claim 1 0, wherein in the step (c) the field to be interpolated takes the original pixel if 
the line has data, and otherwise, takes the median value of the pixel value on the same location of the (n-1)-th 
field, the pixel value on the same location of the (n+1 )-th field, the values of pixels vertically neighboring the pixel 

40 to be interpolated in the n-th field, and the mean value of these pixel values. 

18. A de-interlacing apparatus comprising: 

a bidirectional motion estimating means for obtaining the motion vector between the current field and the 
45 previous field, assigning the motion vector to a field to be interpolated, and estimating the assigned motion 

vector for a field to be interpolated; 

a spatiotemporal smoothing unit for evaluating the accuracy of the motion vector of the current block in the 
field to be interpolated in the bidirectional motion estimating means, and then setting the motion vector of a 
neighboring block, which has the minimum error distortion, as the motion vector of the current block; and 
so a signal converting unit for forming a pixel of a line having no data, with the median value of pixel values 

obtained by applying the motion vector set in the spatiotemporal smoothing unit, the mean value of the pixel 
values, and the values of pixels vertically neighboring the pixel to be interpolated. 

19. An adaptive de-interlacing apparatus comprising: 

55 



a motion evaluating unit for evaluating the degree of motion referring to the value of a motion vector of which 

error distortion between blocks of the previous field and the current field is the minimum; 

a motion-compensated interpolation unit for interpolating with the mean of pixels to which bidirectional motion 
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vector detected for a pixel to be interpolated is applied, or interpolating with the median value of pixel values, 
to which a motion vector is applied, the mean value of the pixels, and the value between two pixels vertically 
neighboring the pixel to be interpolated; 

a spatiotemporal interpolation unit for interpolating with the mean value of pixels neighboring the pixel to be 
interpolated and pixels to be interpolated in the previous field and the next field of the field to be interpolated; 
and 

a motion adaptation unit for adaptively selecting between the interpolation value of the motion-compensated 
interpolation unit and the interpolation value of the spatiotemporal interpolation unit according to the degree 
of motion evaluated in the motion evaluating unit. 

20. An adaptive frame rate converter comprising: 

a motion evaluating unit for evaluating the degree of motion referring to the value of a motion vector of which 
error distortion between blocks of the previous frame and the current frame is the minimum; 
a motion-compensated interpolation unit for interpolating with the mean of pixels to which bidirectional motion 
vector detected for a frame to be interpolated is applied; 

a spatiotemporal interpolation unit for interpolating with the mean value of pixels neighboring the pixel to be 
interpolated and pixels to be interpolated in the previous frame and the next frame of the frame to be interpo- 
lated; and 

a motion adaptation unit for adaptively selecting between the interpolation value of the motion-compensated 
interpolation unit and the interpolation value of the spatiotemporal interpolation unit according to the degree 
of motion evaluated in the motion evaluating unit. 
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